Papers with unsupervised Chinese word segmentation
Unsupervised Neural Word Segmentation for Chinese via Segmental Language Modeling (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to unsupervised Chinese word segmentation (CWS) are discriminative and generative, but they are non-trivial. |
| Approach: | They propose a neural generative model for fully unsupervised Chinese word segmentation (CWS) their approach explicitly focuses on the segmental nature of Chinese, and preserves several properties of language models. |
| Outcome: | The proposed model achieves competitive performance to the state-of-the-art models on four datasets from SIGHAN 2005 bakeoff. |